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Abstract: Underwater object detection is very essential issue for many civilian and military applications such 
as hydrographic survey for the purpose of securing navigation and anchorage areas and planning underwater 
communication cables, pipelines and mine detection. The aim of this work is to provide a flexible, fast and 
accurate underwater object recognition system for use in a variety of underwater low level images captured 
from underwater imaging devices, these imaging devices include (Multibeam Echo Sounder "MBES" and Side 
Scan Sonar "SSS") are used in different times and under varying weather and bathymetric conditions. 
Experiments have been done in front of Alexandria coast (between Sidi Krir and Agamy area) contains 
noticeable features such as pipelines which were utilized and processed. An approach was developed with the 
use of different software packages and applied on the prepared real data to detect objects to assure gathering of 
object details during the processing procedures. Results proved that our system is capable of recognizing 
different underwater objects such as pipelines, rocks and shipwrecks. 
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I. Introduction 

Underwater (Hydrographic) objects are the objects that rise above the bottom surface more than a 
specific amount as defined by IHO survey standards [1]. Object detection normally acquires long time 
processing and analysis by human experts. Side scan automatic processing software packages in object 
recognition field (which is one of the main functions of hydrographic survey) yield obvious discrepancies [7]. 
This can be referred to the differences in shapes and sizes of submerged and buried objects (such as pipelines, 
rocks, and ship's wreck). Physical samples should be gathered at spacing dependent on the seabed geology and 
as required to ground truth any inference technique. 

The main objective of any hydrographic survey equipment is to represent the details of the seabed, and 
to find its features. The nature of the seabed should be determined in potential anchorage areas; it may be 
determined by physical sampling or inferred from other sensors (e.g. single beam echo sounders, side scan sonar 
(SSS), sub-bottom profiler, video, etc.). Manual surveyor method is the base for traditional method for 
processing side scan data that is still in use today by many software applications. This approach means each 
line of side scan data is loaded and then a section of that line is examined for man-made objects and outliers, 
which are manually edited out accordingly. Then comes the role of simple automatic data cleaning algorithms 
for MBES data. 

Despite the fact that manual processing techniques became impractical to deal with massive amount of 
collected data and having a fatal time consuming disadvantage, they may lead to the loss of undefined important 
objects during automatic cleaning process [3]. 

II. Underwater Object Recognition 

Many challenges faced the attempts of creating underwater object recognition tools such as: underwater 
objects Identification which is subject to their surface characteristics and irregular geometric shapes which are 
also affected by underwater currents and silting, a huge target library is needed due to different shapes, scales 
and sizes. 

Real time object recognition is very important especially when dealing with special purpose 
hydrographic survey operations such as dredging operations (for the purpose of deepening harbors, navigation 
lines and underwater mining) which is a cost effective and time constraint operation that needs a precise and fast 
surveyor decision to determine the presence of any objects or obstacles in the dredging zone. 

Many object recognition techniques have been developed. In 2005, Vasile and Marino presented a 
pose-independent automatic target detection and recognition system that uses data from an airborne three- 
dimensional imaging laser radar (LADAR) sensor. The automatic target recognition system uses size signatures 
from target models to detect and recognize targets under heavy camouflage cover in extended terrain scenes. But 
this technique requires predefined target dimensions and characteristics (target library) which is impractical to 
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be applied in seabed features [3]. 

Bonnlander et al. (2006) illustrated that the target criterion articulated by the experts which can be 
informally described by selecting an area and then computing the average of all depth measurements within 
this selected area, and comparing this average to the depth of the shallowest point in the area. This method 
can be applied in remote sensing recognition but needs predefined objects to check its accuracy which is also 
difficult to apply on seabed objects [5]. In 2007, Vasquez stated that available automatic cleaning software have 
a leakage in target recognition field and they may require professional users to deal with them, so it might easily 
happen to lose an important target (ex: pipeline, rock, ships' wreck) during cleaning process with no indication 
about losing important objects [6]. Quintal et al. developed an automated system that eliminates the need for the 
initial manual sidescan review process, which is currently performed by junior hydrographic surveyors. The 
aim was to enable the experienced surveyor to review the sidescan record for data quality and to provide quality 
assurance of the bottom tracking and digitized contacts generated by the Automatic Target Detection software 
which is still time consuming and specialized on sidescan contacts only [7]. 

Available automatic cleaning software has a leakage in target recognition field and they may require 
professional users to deal with them, so it might easily happen to lose an important target (ex: pipeline, rock, 
ship wreck) during cleaning process with no indication about losing important objects [5], An automated system 
was developed that eliminates the need for the initial manual Side Scan Sonar review process. The aim was to 
enable the experienced surveyor to review the side scan record for data quality and to provide quality assurance 
of the bottom tracking and digitized contacts generated by the Automatic Target Detection software. The latest 
technique is still time consuming [6] . 

III. Areas of Investigation and Data Acquisition 

Our experiments were carried out on two phases in two different areas as follows: 

3.1 Phase I 

MBES images were acquired at Sidi Kerir west of Alexandria which contained underwater pipelines (on the 
seabed) as shown in figure(l); the depth of the area varies from 10 to 30 meters. 




Figure 1 : First investigation area location map 

3.2 Phase II 

Side Scan sonar images were acquired from the area near Alexandria port, the depth of the second investigation 
area is about 30 meters. The area of interest contained underwater objects on the seabed such as (pipe, and a 
sunken ship wreck and a boat wreck). The study area was scanned according to IHO standard S-44 [1]. 




Figure 2: Second investigation area location map 



IV. Real Data Preparation and Processing 

The collected data was corrected for tide, sound velocity and offset adjustment during the period of the survey to 
produce edited data. Processing of our case study hydrographic real data containing obvious features (pipelines) 
was done using manual procedures so it can be used as a reference for verification which was time consuming. 
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At last, a scanned surface was created by the sonar device and was exported as XYZ data to be ready for using it 
easily in other processing software. 

V. Object Analysis and Recognition 

Our object recognition approach was applied in order to speed up the object recognition process by 
simplifying these objects to the nearest geometrical shape. Acquired MBES Real data contained three pipelines, 
which was used for testing the proposed approach, and then artificial data was generated and processed using 
the prementioned approach to check the validity of this approach. Artificial objects represented a sample of the 
most common underwater objects were tested; objects included a pipe, partial ship wreck and a rock. The 
proposed approach can be summarized in the following steps: 

• Sonar data acquisition. 

• Format Conversion : 

o Conversion of the acquired XYZ data to 3D image by creating triangles (TIN surface) to join these 

points and represent them as a three dimensional surface, 
o Converting 3D image to 2D image. 

• Feature extraction by representing with shape vector. 

• Object recognition using nearest geometrical shape. 

• Validation phase using simulation data. 

Applying the above steps to the MBES output as follows: 

5.1 Sonar Data Acquisition: 

Data is acquired from the MBES as XYZ data file format which identifies the location of all shape 
points, hence defines the sea bottom objects. 

5.2 Format Conversion 

Selected real data exported from MBES system as XYZ data, and then triangles were plotted using 
Triangulated Irregular Network technique (TIN surface) to join these data and represent it as a three dimensional 
surface. The Triangulated Irregular Network connects each three soundings to make a (triangle face) as shown 
in figure 3. 

These forces can be used to represent an interpolated surface. Selected area has been rotated to horizontal view 
in MATLAB® (to facilitate the recognition process and comparison) as shown in Figure (4). 




Figure 4: Pipelines shown in 3D surfaces 
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5.3 Feature extraction 

Triangulated 3D recording points (X,Y,Z data) were transformed to (dat) file format which was then 
converted to a 2D image using ERDAS 8.4®, by checking the output 2D image as seen in figure (5), we 
recognize the presence of three pipelines in the chosen data. 2D images were then exported to MATLAB® for 
feature extraction via MATLAB code. 




I 

Figure 5: 2D images showing three pipelines 

5.4 Object Recognition Using Nearest Geometrical Shape 

The generated images (shown in figure (6)) are then recognized via MATLAB® code generated for 
object recognition using nearest geometrical shape. The figure shows that objects (pipelines) were recognized 
via the developed MATLAB® recognition code the three pipelines were all recognized (100% detection). 




Load Image 





Figure 6: Recognition results illustrating obvious pipelines 
5.5 Side Scan Sonar Object Recognition 

The approach was applied to side scan sonar survey data which contained three underwater objects as stated 
before, the data acquired from area near Alexandria port contained underwater objects on the seabed which 
included ( pipe, and a sunk ship wreck and a boat wreck). 

The side scan sonar is a successful tool for object detection. Side-scan sonar has been for a long period 
the only available instrument for mapping seabed features on a broad scale. 

• Pipeline: The pipeline image shown in figure (6) obtained from the side scan sonar was processed for feature 
extraction code in MATLAB ®, the generated segment was then applied to the recognition code which 
recognized the shape as a rect angular shape and hence it represents pipeline. 




Figure 7: Side scan object recognized as pipeline 
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• Shipwreck : two ship wrecks were detected by side scan sonar that are shown in figures (8) and (9) 
consecutively, objects were processed for feature extraction code in MATLAB ®, the generated segments 
were then applied to the recognition code which recognized the shapes as ellipsoidal and hence they represent 
shipwrecks. 



























Side Sean image segmentation 













Figure 8: Side scan object recognized as shipwreck 




Figure 9: Object recognized as shipwreck(small boat) 
VI. Validation of the Object Recognition Approach Using Generated Objects 
6.1 Object Generation 

Artificial objects were generated which represent a sample of the most common underwater objects which 
included a pipe, partial ship wreck and a rock . Objects were generated Using AutoCad® software package; 
artificial surfaces were created in 3D space simulating a depth of 30m with 0.25m cell size and containing three 
objects. These sample objects are as follows: 

• Pipe (representing pipeline with 0.5m radius). 

• Ship wreck (6.5m Length, 1.3m width). 

• Rock (1.75m Length, 2m width). 
• 

The surface containing sample objects was exported from AutoCAD® file as XYZ data in order to 
resemble the MBES output data, then this XYZ data was imported in Hypackmax® software using Triangulated 
Irregular Network (TIN) program to be surfaced and viewed as the surface as shown in Figure (10). 








Figure 10: Artificial objects surface 

6.2 Data Preparation 

The generated artificial data was loaded as XYZ data with cell size 10 cm into three variables (X, Y and Z). 
Using special MATLAB® code, triangles were created (TIN surface) to join these data and represent them as 
3D surface as shown in Figure (11). 
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Figure 11: 3D surface including the three artificial objects 

The triangulated surface including the three artificial objects (from right to left as shown in Figure (11): 
pipe, shipwreck and a rock) was cleaned from both axis and triangles as shown in Figure (12) to be ready for 2D 
image conversion. 




Figure 12: Cleaned 3D surface 



6.3 Image Processing 

The triangulated X, Y, Z data exported to Surfer 8® software to transform it from XYZ file format to Dat file 
format. Figure (13) illustrates the data file after converted to 2D image using ERDAS 8.4® software .The 2D 
image shows the objects in one layer regardless of the depth variation. The next step was representing the 2D 
image into vectors using MATLAB® software package. 




Figure 13: 2D surface with three objects 



6.4 Object Recognition 

The vectorized image was loaded in the object recognition model using nearest geometrical shape via 
MATLAB® code (Trieu, 2010) as shown in figure (14). 




Recognize 

Figure 14: artificial objects recognition 

Objects recognized from left to right as follows: 

• Rectangle: object is recognized as a pipe (a pipeline). 

• Ellipse: object is recognized as ship wreck. 

• Circle: object is recognized as a rock. 
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The advantages of the proposed approach are as follows : 

• Less processing time as it is considered a fast approach can be used for fast and instantaneous check. 

• It can deal with a large amount of data and target library is not needed. 

VII. Conclusion 

This research applies a quick underwater object recognition approach which is capable of recognizing 
underwater objects obtained from imaging devices (Multibeam Echo Sounder (MBES), and Side Scan 
Sonar(SSS)) to aid the hydrographic surveyor to analyze the MBES output and SSS images in the cost effective 
and time constraint operations that need a precise and fast surveyor decision to determine the presence of any 
objects or obstacles in a certain area. 
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